Utilizing depth from ultrasound volume rendering for 3d printing

ABSTRACT

Various embodiments include systems and methods for utilizing depth from ultrasound volume rendering for 3D printing. Volumetric ultrasound dataset may be generated, based on echo ultrasound signals, and one or more volume rendered ultrasound images, based on the volumetric ultrasound dataset, may be displayed. Based on the one or more volume rendered ultrasound images and/or the volumetric ultrasound dataset, three-dimensional (3D) printing data may be generated. The 3D printing data may be configured to enable producing, via a 3D printer, a physical volume representation of one or more objects and/or structures in the one or more volume rendered ultrasound images. The 3D printing data may be based on 3D modeling of at least a portion of at least one of the one or more volume rendered ultrasound images. The 3D modeling may comprise a surface mesh representation.

CLAIMS OF PRIORITY

This application is a continuation (CON) of U.S. patent application Ser.No. 14/882,979 filed Oct. 14, 2015. The above identified application ishereby incorporated herein by reference in its entirety.

FIELD OF THE INVENTION

Certain embodiments of the invention relate to ultrasound imaging. Morespecifically, certain embodiments of the invention relate to methods andsystems for utilizing depth from ultrasound volume rendering forthree-dimensional (3D) printing.

BACKGROUND OF THE INVENTION

Ultrasound imaging is a medical imaging technique for imaging organs andsoft tissues in a human body. Ultrasound imaging uses real time,non-invasive high frequency sound waves to produce ultrasound images.These ultrasound images may be two-dimensional (2D), three-dimensional(3D), and/or four-dimensional (4D) images (which may essentially bereal-time/continuous 3D images).

With 3D (and similarly 4D) images, volumetric ultrasound datasets may beacquired and used in rendering the ultrasound images (e.g., via adisplay). In some instances, it may be desirable to print copies of theultrasound images. For example, parents may want printouts of ultrasoundimages displayed during obstetric (OB) ultrasound imaging. Typicallyultrasound images (regardless of whether they are 2D or 3D/4D) are onlyprinted 2D (e.g. on flat sheets).

Further limitations and disadvantages of conventional and traditionalapproaches will become apparent to one of skill in the art, throughcomparison of such systems with some aspects of the present invention asset forth in the remainder of the present application with reference tothe drawings.

BRIEF SUMMARY OF THE INVENTION

A system and/or method is provided for utilizing depth from ultrasoundvolume rendering for 3D printing, substantially as shown in and/ordescribed in connection with at least one of the figures, as set forthmore completely in the claims.

These and other advantages, aspects and novel features of the presentinvention, as well as details of an illustrated embodiment thereof, willbe more fully understood from the following description and drawings.

BRIEF DESCRIPTION OF SEVERAL VIEWS OF THE DRAWINGS

FIG. 1 is a block diagram illustrating an example ultrasound system thatmay be used in ultrasound imaging, which may support three-dimensional(3D) printing, in accordance with various embodiments of the invention.

FIG. 2 is a block diagram illustrating an example use of ultrasoundsystem during three-dimensional (3D) printing, in accordance with anexample embodiment of the invention.

FIGS. 3A-3C illustrate example use of data corresponding to ultrasoundvolume rendering in generating polygon meshes for three-dimensional (3D)printing, in accordance with an example embodiment of the invention.

FIG. 4 is a flow chart illustrating example steps that may be performedfor utilizing data from ultrasound volume rendering forthree-dimensional (3D) printing, in accordance with an embodiment of theinvention.

DETAILED DESCRIPTION OF THE INVENTION

Certain embodiments of the invention may be found in methods and systemsfor utilizing depth from ultrasound volume rendering forthree-dimensional (3D) printing. For example, aspects of the presentinvention have the technical effect of facilitating 3D printing duringultrasound imaging by generating 3D printing data based on the volumerendered ultrasound images. In this regard, volumetric ultrasounddataset may be generated, such as based on echo ultrasound signals,volume rendered ultrasound images may be generated and/or displayed,based on the volumetric ultrasound dataset. The 3D printing data maythen be generated, based on the volume rendered ultrasound images and/orthe volumetric ultrasound dataset, with the 3D printing data beingconfigured to enable producing, via a 3D printer, a physical volumerepresentation of one or more objects and/or structures in the volumerendered ultrasound images. The 3D printing data may be based on 3Dmodeling of at least a portion of at least one volume renderedultrasound image. The 3D modeling may comprise a surface meshrepresentation (e.g., 2D or 3D) of the volume rendered ultrasound image,or the at least portion thereof.

The foregoing summary, as well as the following detailed description ofcertain embodiments will be better understood when read in conjunctionwith the appended drawings. To the extent that the figures illustratediagrams of the functional blocks of various embodiments, the functionalblocks are not necessarily indicative of the division between hardwarecircuitry. Thus, for example, one or more of the functional blocks(e.g., processors or memories) may be implemented in a single piece ofhardware (e.g., a general purpose signal processor or a block of randomaccess memory, hard disk, or the like) or multiple pieces of hardware.Similarly, the programs may be stand-alone programs, may be incorporatedas subroutines in an operating system, may be functions in an installedsoftware package, and the like. It should be understood that the variousembodiments are not limited to the arrangements and instrumentalityshown in the drawings. It should also be understood that the embodimentsmay be combined, or that other embodiments may be utilized and thatstructural, logical and electrical changes may be made without departingfrom the scope of the various embodiments of the present invention. Thefollowing detailed description is, therefore, not to be taken in alimiting sense, and the scope of the present invention is defined by theappended claims and their equivalents.

As used herein, an element or step recited in the singular and proceededwith the word “a” or “an” should be understood as not excluding pluralof said elements or steps, unless such exclusion is explicitly stated.Furthermore, references to “an embodiment,” “one embodiment,” “arepresentative embodiment,” “an example embodiment,” “variousembodiments,” “certain embodiments,” and the like are not intended to beinterpreted as excluding the existence of additional embodiments thatalso incorporate the recited features. Moreover, unless explicitlystated to the contrary, embodiments “comprising,” “including,” or“having” an element or a plurality of elements having a particularproperty may include additional elements not having that property.

In addition, as used herein, the phrase “pixel” also includesembodiments of the present invention where the data is represented by a“voxel.” Thus, both the terms “pixel” and “voxel” may be usedinterchangeably throughout this document.

Also as used herein, the term “image” broadly refers to both viewableimages and data representing a viewable image. However, many embodimentsgenerate (or are configured to generate) at least one viewable image. Inaddition, as used herein, the phrase “image” is used to refer to anultrasound mode such as B-mode, CF-mode and/or sub-modes of CF such asTVI, Angio, B-flow, BMI, BMI Angio, and in some cases also MM, CM, PW,TVD, CW where the “image” and/or “plane” includes a single beam ormultiple beams.

Furthermore, the term processor or processing unit, as used herein,refers to any type of processing unit that can carry out the requiredcalculations needed for the invention, such as single or multi-core:CPU, Graphics Board, DSP, FPGA, ASIC, or a combination thereof.

It should be noted that various embodiments described herein thatgenerate or form images may include processing for forming images thatin some embodiments includes beamforming and in other embodiments doesnot include beamforming. For example, an image can be formed withoutbeamforming, such as by multiplying the matrix of demodulated data by amatrix of coefficients so that the product is the image, and wherein theprocess does not form any “beams.” Also, forming of images may beperformed using channel combinations that may originate from more thanone transmit event (e.g., synthetic aperture techniques).

In various embodiments, ultrasound processing, including visualizationenhancement, to form images may be performed, for example, in software,firmware, hardware, or a combination thereof. One implementation of anultrasound system in accordance with various embodiments is illustratedin FIG. 1.

FIG. 1 is a block diagram illustrating an example ultrasound system thatmay be used in ultrasound imaging, which may support three-dimensional(3D) printing, in accordance with various embodiments of the invention.

FIG. 1 is a block diagram illustrating an example ultrasound system thatmay be used in ultrasound imaging, which may support amniotic fluidposition detection based on shear wave propagation, in accordance withvarious embodiments of the invention. Shown in FIG. 1 is an ultrasoundsystem 100.

The ultrasound system 100 comprises, for example, a transmitter 102, anultrasound probe 104, a transmit beamformer 110, a receiver 118, areceive beamformer 122, a RF processor 124, a RF/IQ buffer 126, a userinput module 130, a signal processor 140, an image buffer 136, and adisplay system 150.

The transmitter 102 may comprise suitable circuitry that may be operableto drive an ultrasound probe 104. The transmitter 102 and the ultrasoundprobe 104 may be implemented and/or configured for one-dimensional (1D),two-dimensional (2D), three-dimensional (3D), and/or four-dimensional(4D) ultrasound scanning. In this regard, ultrasound probe 104 maycomprise a one-dimensional (1D, 1.25D, 1.5D or 1.75D) array or atwo-dimensional (2D) array of piezoelectric elements. For example, asshown in FIG. 1, the ultrasound probe 104 may comprise a group oftransmit transducer elements 106 and a group of receive transducerelements 108, that normally constitute the same elements. Thetransmitter 102 may be driven by the transmit beamformer 110.

The transmit beamformer 110 may comprise suitable circuitry that may beoperable to control the transmitter 102 which, through a transmitsub-aperture beamformer 114, drives the group of transmit transducerelements 106 to emit ultrasonic transmit signals into a region ofinterest (e.g., human, animal, underground cavity, physical structureand the like). In this regard, the group of transmit transducer elements106 can be activated to transmit ultrasonic signals. The ultrasonicsignals may comprise, for example, pulse sequences that are firedrepeatedly at a pulse repetition frequency (PRF), which may typically bein the kilohertz range. The pulse sequences may be focused at the sametransmit focal position with the same transmit characteristics. A seriesof transmit firings focused at the same transmit focal position may bereferred to as a “packet.”

The transmitted ultrasonic signals may be back-scattered from structuresin the object of interest, like tissue, to produce echoes. The echoesare received by the receive transducer elements 108. The group ofreceive transducer elements 108 in the ultrasound probe 104 may beoperable to convert the received echoes into analog signals, undergosub-aperture beamforming by a receive sub-aperture beamformer 116 andare then communicated to the receiver 118.

The receiver 118 may comprise suitable circuitry that may be operable toreceive and demodulate the signals from the probe transducer elements orreceive sub-aperture beamformer 116. The demodulated analog signals maybe communicated to one or more of the plurality of A/D converters (ADCs)120.

Each plurality of A/D converters 120 may comprise suitable circuitrythat may be operable to convert analog signals to corresponding digitalsignals. In this regard, the plurality of A/D converters 120 may beconfigured to convert demodulated analog signals from the receiver 118to corresponding digital signals. The plurality of A/D converters 120are disposed between the receiver 118 and the receive beamformer 122.Notwithstanding, the invention is not limited in this regard.Accordingly, in some embodiments of the invention, the plurality of A/Dconverters 120 may be integrated within the receiver 118.

The receive beamformer 122 may comprise suitable circuitry that may beoperable to perform digital beamforming processing to, for example, sumthe delayed channel signals received from the plurality of A/Dconverters 120 and output a beam summed signal. The resulting processedinformation may be converted back to corresponding RF signals. Thecorresponding output RF signals that are output from the receivebeamformer 122 may be communicated to the RF processor 124. Inaccordance with some embodiments of the invention, the receiver 118, theplurality of A/D converters 120, and the beamformer 122 may beintegrated into a single beamformer, which may be digital.

The RF processor 124 may comprise suitable circuitry that may beoperable to demodulate the RF signals. In some instances, the RFprocessor 124 may comprise a complex demodulator (not shown) that isoperable to demodulate the RF signals to form In-phase and quadrature(IQ) data pairs (e.g., B-mode data pairs) which may be representative ofthe corresponding echo signals. The RF (or IQ) signal data may then becommunicated to an RF/IQ buffer 126.

The RF/IQ buffer 126 may comprise suitable circuitry that may beoperable to provide temporary storage of output of the RF processor124—e.g., the RF (or IQ) signal data, which is generated by the RFprocessor 124.

The user input module 130 may comprise suitable circuitry that may beoperable to enable obtaining or providing input to the ultrasound system100, for use in operations thereof. For example, the user input module130 may be used to input patient data, surgical instrument data, scanparameters, settings, configuration parameters, change scan mode, andthe like. In an example embodiment of the invention, the user inputmodule 130 may be operable to configure, manage and/or control operationof one or more components and/or modules in the ultrasound system 100.In this regard, the user input module 130 may be operable to configure,manage and/or control operation of transmitter 102, the ultrasound probe104, the transmit beamformer 110, the receiver 118, the receivebeamformer 122, the RF processor 124, the RF/IQ buffer 126, the userinput module 130, the signal processor 140, the image buffer 136, and/orthe display system 150.

The signal processor 140 may comprise suitable circuitry that may beoperable to process the ultrasound scan data (e.g., the RF and/or IQsignal data) and/or to generate corresponding ultrasound images, such asfor presentation on the display system 150. The signal processor 140 isoperable to perform one or more processing operations according to aplurality of selectable ultrasound modalities on the acquired ultrasoundscan data. In some instances, the signal processor 140 may be operableto perform compounding, motion tracking, and/or speckle tracking.Acquired ultrasound scan data may be processed in real-time—e.g., duringa B-mode scanning session, as the B-mode echo signals are received.Additionally or alternatively, the ultrasound scan data may be storedtemporarily in the RF/IQ buffer 126 during a scanning session andprocessed in less than real-time in a live or off-line operation.

In operation, the ultrasound system 100 may be used in generatingultrasonic images, including two-dimensional (2D), three-dimensional(3D), and/or four-dimensional (4D) images. In this regard, theultrasound system 100 may be operable to continuously acquire ultrasoundscan data at a particular frame rate, which may be suitable for theimaging situation in question. For example, frame rates may range from20-70 but may be lower or higher. The acquired ultrasound scan data maybe displayed on the display system 150 at a display-rate that can be thesame as the frame rate, or slower or faster. An image buffer 136 isincluded for storing processed frames of acquired ultrasound scan datathat are not scheduled to be displayed immediately. Preferably, theimage buffer 136 is of sufficient capacity to store at least severalseconds' worth of frames of ultrasound scan data. The frames ofultrasound scan data are stored in a manner to facilitate retrievalthereof according to its order or time of acquisition. The image buffer136 may be embodied as any known data storage medium.

In some instances, the ultrasound system 100 may be configured tosupport grayscale and color based operations. For example, the signalprocessor 140 may be operable to perform grayscale B-mode processingand/or color processing. The grayscale B-mode processing may compriseprocessing B-mode RF signal data or IQ data pairs. For example, thegrayscale B-mode processing may enable forming an envelope of thebeam-summed receive signal by computing the quantity (I²±Q²)^(1/2). Theenvelope can undergo additional B-mode processing, such as logarithmiccompression to form the display data. The display data may be convertedto X-Y format for video display. The scan-converted frames can be mappedto grayscale for display. The B-mode frames that are provided to theimage buffer 136 and/or the display system 150. The color processing maycomprise processing color based RF signal data or IQ data pairs to formframes to overlay on B-mode frames that are provided to the image buffer136 and/or the display system 150. The grayscale and/or color processingmay be adaptively adjusted based on user input—e.g., a selection fromthe user input module 130, for example, for enhance of grayscale and/orcolor of particular area.

In some instances, ultrasound imaging may include generation and/ordisplay of volumetric ultrasound images—that is where objects (e.g.,organs, tissues, etc.) are displayed three-dimensional 3D. In thisregard, with 3D (and similarly 4D) imaging, volumetric ultrasounddatasets may be acquired, comprising voxels that correspond to theimaged objects. This may be done, e.g., by transmitting the sound wavesat different angles rather than simply transmitting them in onedirection (e.g., straight down), and then capture their reflectionsback. The returning echoes (of transmissions at different angles) arethen captured, and processed (e.g., via the signal processor 140) togenerate the corresponding volumetric datasets, which may in turn beused (e.g., via a 3D rendering module 142 in the signal processor 140)in creating and/or displaying volume (e.g. 3D) images, such as via thedisplay 150. This may entail use of particular handling techniques toprovide the desired 3D perception. For example, volume renderingtechniques may be used in displaying projections (e.g., 2D projections)of the volumetric (e.g., 3D) datasets. In this regard, rendering a 2Dprojection of a 3D dataset may comprise setting or defining a perceptionangle in space relative to the object being displayed, and then definingor computing necessary information (e.g., opacity and color) for everyvoxel in the dataset. This may be done, for example, using suitabletransfer functions for defining RGBA (red, green, blue, and alpha) valuefor every voxel.

In some instances, it may be desirable to print copies of the ultrasoundimages. For example, parent(s) may want to have printout of theultrasound images displayed during obstetric (OB) ultrasound imaging.Typically copies of the ultrasound images (regardless of whether theyare 2D or 3D/4D) are only printed two-dimensionally (e.g., as 2Dblack-and-white or colored sheets). However, 3D printing is alsobecoming popular. In 3D printing, three-dimensional (volume) physicalobjects may be synthesized, using suitable 3D printers. In this regard,3D printers may, for example, utilize additive processes to laysuccessive layers of material. The synthesized volume objects may be ofalmost any shape and/or geometry. The 3D printers and/or operationsthereof (during 3D printing) may be configured and/or controlled basedon data (referred to hereafter as “3D printing data”), which may begenerated and/or formatted in accordance with one or more definedformats for use in 3D printing, such as STL (STereoLithography) fileformat based data. In this regard, the 3D printing data may compriseinformation corresponding to and/or representing the would-be printedobjects (or structures thereof). For example, the 3D printing data maycomprise and/or be based on 3D modeling (or information relatingthereto) of the would-be printed objects.

Accordingly, in various embodiments in accordance with the presentdisclosure, ultrasound imaging may support 3D printing. This may be doneby, for example, utilizing volumetric ultrasound datasets (e.g., via a3D printing module 144 in the signal processor 140) to generate and/orconfigure 3D printing data, which may be provided to 3D printers toperform the 3D printing. An example ultrasound imaging setup that may beused in supporting 3D printing is depicted in FIG. 2.

Some challenges may exist when generating such 3D printing data,however. For example, quality of the 3D printing may (e.g., due toquality and/or accuracy of the 3D printing data) depend on and/or beadversely affected by characteristics of the ultrasound imaging, such asbad signal quality (e.g., due to noise, speckle, acoustic shadowing,etc.), difficult tissue differentiation with no defined gray values todistinguish anatomical objects, etc. Thus, the generation of 3D printingdata (e.g., via the 3D printing module 144) based on the ultrasoundimaging and/or the volumetric ultrasound datasets acquired during suchimaging may be configured and/or adjusted to optimize the quality of 3Dprinting, such as by adaptively configuring and/or controlling thegeneration of the 3D printing data, to account for such issues and/ordefects for example.

In some example embodiments, the 3D printing data may be generated basedon surface mesh representation (e.g., polygon mesh) suitable for 3Dprinting. A polygon mesh may be a collection of vertices, edges, and/orpolygons faces (e.g., triangles, quadrilaterals, etc.) for defining theshape of an object in a polyhedral manner, to facilitate 3D modeling ofthat object. Such surface mesh representations may be obtained by, forexample, converting 3D scalar volume data. For example, depthinformation may be extracted (e.g., via the 3D rendering module 142)based on volumetric ultrasound datasets and/or volume rendering, andthis depth information may then be used (e.g., via the 3D printingmodule 144) in creating a relief like mesh. The surface meshrepresentation may be a 2D mesh. In certain example embodiments,however, 3D mesh representations may be created. For example, two ormore volume renderings, such as from different viewing directions, maybe used to create not only a relief mesh but a full 3D mesh.

FIG. 2 is a block diagram illustrating an example use of ultrasoundsystem during three-dimensional (3D) printing, in accordance with anexample embodiment of the invention. Shown in FIG. 2 is a setup 200,comprising an ultrasound system 210 and a 3D printer 220.

The ultrasound system 210 may be substantially similar to the ultrasoundsystem 100, and as such may comprise generally similar components asdescribed with respect to the ultrasound system 100 of FIG. 1. As shownin FIG. 2, the ultrasound system 210 may comprise a portable and movableultrasound probe 212 and a display/control unit 212. The ultrasoundprobe 212 may be used in generating and/or capturing ultrasound images(or data corresponding thereto), such as by being moved over a patient'sbody (or part thereof). The display/control unit 212 may be used indisplaying ultrasound images (e.g., via a screen 216). Further, thedisplay/control unit 212 may support user interactions (e.g., via usercontrols 218), such as to allow controlling of the ultrasound imaging.The user interactions may comprise user input or commands controllingdisplay of ultrasound images, selecting settings, specifying userpreferences, providing feedback as to quality of imaging, etc.

The 3D printer 220 may be operable to perform 3D printing. In thisregard, the 3D printer 220 may be configured to produce (e.g.,synthesize) three-dimensional physical representations, such as based onthe 3D printing data corresponding to and/or based on 3D model of thewould-be printed objects. The 3D printer 220 may be any of commerciallyavailable products, which may be communicatively coupled to theultrasound system 210, via suitable connections, wired (e.g., cords)and/or wireless (e.g., WiFi, Bluetooth, etc.). The 3D printer 220 mayalso be part of the ultrasound system 210 itself, and may even byincorporated directly into it.

In operation, the ultrasound system 210 may be used in ultrasoundimaging, such as to generate and present (e.g., display) ultrasoundimages, including 2D, 3D, and/or 4D ultrasound images, and/or to supportuser input in conjunction therewith, substantially as described withrespect to FIG. 1. Further, however, the ultrasound system 210 may beoperable to support 3D printing via the 3D printer 220, substantially asdescribed with respect to FIG. 1. The 3D printing may correspond toprinting volume (3D) representations of objects and/or structures indisplayed ultrasound images. For example, this may be done by utilizingvolumetric ultrasound datasets acquired and/or generated in theultrasound system 210 to generate and/or configure 3D printing data 230,which may be provided (e.g., communicated, such as via wired and/orwireless connections) to the 3D printer 220. In this regard, the 3Dprinting may be configured based on 3D modelling of the objects and/orstructures in the ultrasound images, and/or may be particularlyformatted based on the supported printing data formats in the 3D printer220. Further, the generation of the 3D printing data 230 may beadaptively configured and/or controlled, to account for and/or mitigatepossible issues and/or defects relating to the ultrasound imaging and/ordata corresponding thereto.

In an example implementation, the ultrasound system 210 may be operableto generate the 3D printing data 230 based on surface meshrepresentation, such as a 2D or 3D polygon (e.g., triangle) mesh, whichmay be generated based on the volumetric ultrasound datasets acquiredvia the ultrasound system 210 and/or volume rendering based thereon. Inan example use scenario, a direct volume rendering may be used ingenerating 2D image from a volumetric ultrasound dataset. For example,in instances where ultrasound imaging is configured based on the RGBcolor model (to provide colored ultrasound images), in addition to theRGB color information forming the 2D image, a depth value is computedfor every pixel. The depth information may then be used in creating arelief-like mesh (e.g., polygon mesh), where the depth values are usedas the height for a regular grid of vertices which are connect bypolygons (e.g., triangles) to form a closed mesh. The depth value may bethe centroid of the opacity increase for each ray along depth. Anexample of generation of a mesh representation based on volume datasetsand/or volume rendering during ultrasound imaging is illustrated in moredetail with respect to FIGS. 3A-3C, below.

Providing 3D printing in this manner—that is based on and/or inconjunction with ultrasound imaging—is be advantageous. This approachwould ensure that 3D prints (objects) would look exactly as therendering on the screen 216. Also, a fully automated workflow fromvolume data to 3D printing is possible with this approach, allowing forefficient and/or easy-to-use operation. Further, the renderingoperations may enhance the quality of the 3D printing—e.g., therendering algorithm may act as non-linear filter smoothing the data andproducing very reliable depth information compared to other segmentationmethods. The rendered image (which matches the mesh) may also be used intexturing (e.g., colorizing) the 3D prints, the enhance quality (e.g.,realism) of printed objects. This approach may also allow for control ofthe 3D printing by the user, such as based on user input (provided viathe user controls 218). For example, the 3D printing may be controlledby the user based on user input relating to the volume rendering (e.g.,selection of viewpoint, scaling, threshold, etc.). Further, the 3Dprinting may reflect use of techniques available for volume rendering,such as to cut away unwanted parts of the volume (e.g., masking withMagiCut, Vocal, Threshold, etc.). In other words, the 3D prints may onlyinclude the wanted parts of the objects.

FIGS. 3A-3C illustrate example use of data corresponding to ultrasoundvolume rendering in generating polygon meshes for three-dimensional (3D)printing, in accordance with an example embodiment of the invention.

Shown in FIG. 3A is a volume rendered image 410, with depth. The image410 may be rendered using volumetric ultrasound datasets, which may beacquired via an ultrasound system, such as the ultrasound system 210 ofFIG. 2. The volumetric ultrasound datasets may comprise data (e.g.,relating to ultrasound echoes) obtained from one or more angles ordirections. Once acquired, the volumetric ultrasound datasets may beprocessed for volume (3D) rendering, such as via the 3D rendering module142 of the signal processor 140. The volume rendering may comprisegenerating a projection (e.g., 2D projection) that provides the desired3D perception. Processing relating to the volume rendering may comprise,for example, determining depth information (e.g., for each voxel), andusing that depth information in the 2D projection.

Shown in FIG. 3B is an example mesh 420, which may be generated (e.g.,from a slightly different angle) based on the volume rendered image 410or volumetric dataset corresponding thereto, substantially as describedabove. In this regard, the mesh 420 may be created using depth valuescomputed for the volume rendered image 410 (e.g., from the volumetricdataset, for every voxel), based on the defined angle for the mesh 420,such as by applying the depth values as the height for each regular gridof vertices which are connect by polygons (e.g., triangles) to form themesh 410. Details of an example mesh are shown in FIG. 3C, which depictsa zoomed-in section in the mesh 420 (shown as a dashed box in FIG. 3B)to illustrated polygons in the mesh.

FIG. 4 is a flow chart illustrating example steps that may be performedfor utilizing data from ultrasound volume rendering forthree-dimensional (3D) printing, in accordance with an embodiment of theinvention. Shown in FIG. 4 is a flow chart 400, which comprises aplurality of example steps, corresponding to an example method.

The technical effect of the method corresponding to flow chart 400 issupporting three-dimensional (3D) printing (e.g., by generating data orfiles based thereon using the in 3D printers) based on the data acquiredand/or generated for ultrasound volume rendering in an ultrasound system(e.g., the ultrasound system 100). For example, the example steps of themethod corresponding to flow chart 400 may be executed and/or performedby the various components of the ultrasound system 100.

It should be understood, however, that certain embodiments of thepresent invention may omit one or more of the steps, and/or perform thesteps in a different order than the order listed, and/or combine certainof the steps discussed below. For example, some steps may not beperformed in certain embodiments of the present invention. As a furtherexample, certain steps may be performed in a different temporal order,including simultaneously, than listed below.

In step 402, after a start step (in which an ultrasound system may be,for example, initialized and/or configured for ultrasound imaging),volumetric ultrasound signals (echoes of signal transmitted fromdifferent angles) may be acquired.

In step 404, corresponding volumetric ultrasound datasets may begenerated based on the acquired ultrasound images.

In step 406, corresponding volumetric ultrasound images may be generatedand/or displayed (e.g., using volume rendering).

In step 408, 3D printing data may be generated. This may be done, asdescribed above with respect to FIG. 2 for example, by computing depthvalues for each of the voxels, and using the depth values in creating 3Dmodel (e.g., polygon mesh, where the depth values are used as the heightfor a regular grid of vertices which are connect by polygon, such astriangles, to form a closed mesh), which in turn may be used (directlyor via suitable formatting) as the 3D printing data.

In step 410, the corresponding volume (3D) objects may be printed (e.g.,synthesized) based on the 3D printing data.

As utilized herein the term “circuitry” refers to physical electroniccomponents (e.g., hardware) and any software and/or firmware (“code”)which may configure the hardware, be executed by the hardware, and orotherwise be associated with the hardware. As used herein, for example,a particular processor and memory may comprise a first “circuit” whenexecuting a first one or more lines of code and may comprise a second“circuit” when executing a second one or more lines of code. As utilizedherein, “and/or” means any one or more of the items in the list joinedby “and/or.” As an example, “x and/or y” means any element of thethree-element set {(x), (y), (x, y)}. As another example, “x, y, and/orz” means any element of the seven-element set {(x), (y), (z), (x, y),(x, z), (y, z), (x, y, z)}. As utilized herein, the term “example” meansserving as a non-limiting example, instance, or illustration. Asutilized herein, the terms “for example” and “e.g.,” set off lists ofone or more non-limiting examples, instances, or illustrations. Asutilized herein, circuitry is “operable” to perform a function wheneverthe circuitry comprises the necessary hardware and code (if any isnecessary) to perform the function, regardless of whether performance ofthe function is disabled, or not enabled, by some user-configurablesetting.

Other embodiments of the invention may provide a computer readabledevice and/or a non-transitory computer readable medium, and/or amachine readable device and/or a non-transitory machine readable medium,having stored thereon, a machine code and/or a computer program havingat least one code section executable by a machine and/or a computer,thereby causing the machine and/or computer to perform the steps asdescribed herein for utilizing depth from ultrasound volume renderingfor three-dimensional (3D) printing.

Accordingly, the present invention may be realized in hardware,software, or a combination of hardware and software. The presentinvention may be realized in a centralized fashion in at least onecomputer system, or in a distributed fashion where different elementsare spread across several interconnected computer systems. Any kind ofcomputer system or other apparatus adapted for carrying out the methodsdescribed herein is suited. A typical combination of hardware andsoftware may be a general-purpose computer system with a computerprogram that, when being loaded and executed, controls the computersystem such that it carries out the methods described herein.

The present invention may also be embedded in a computer programproduct, which comprises all the features enabling the implementation ofthe methods described herein, and which when loaded in a computer systemis able to carry out these methods. Computer program in the presentcontext means any expression, in any language, code or notation, of aset of instructions intended to cause a system having an informationprocessing capability to perform a particular function either directlyor after either or both of the following: a) conversion to anotherlanguage, code or notation; b) reproduction in a different materialform.

While the present invention has been described with reference to certainembodiments, it will be understood by those skilled in the art thatvarious changes may be made and equivalents may be substituted withoutdeparting from the scope of the present invention. In addition, manymodifications may be made to adapt a particular situation or material tothe teachings of the present invention without departing from its scope.Therefore, it is intended that the present invention not be limited tothe particular embodiment disclosed, but that the present invention willinclude all embodiments falling within the scope of the appended claims.

What is claimed is:
 1. A system, comprising: an ultrasound device,comprising at least one processor, wherein the ultrasound device:generates volumetric ultrasound dataset, based on echo ultrasoundsignals; generates based on the volumetric ultrasound dataset, aplurality of volume renderings from different viewing directions:generates, based on the plurality of volume renderings, a 3D mesh; andgenerates, based on the 3D mesh, three-dimensional (3D) printing data;wherein the 3D printing data is configured to enable producing, via aprinter, a physical volume representation of one or more objects and/orstructures in ultrasound images rendered based on the volumetricultrasound dataset.
 2. The system of claim 1, wherein the ultrasounddevice: generates 3D modeling of at least a portion of the one or moreobjects and/or structures; and generates the 3D mesh based on the 3Dmodeling.
 3. The system of claim 1, wherein the ultrasound device, whengenerating the 3D mesh: computes one or more depth values, eachassociated with one voxel, corresponding to at least the portion of theone or more objects and/or structures; and applies the computed one ormore depth values as height to a grid of plurality of vertices connectedby a plurality of polygons.
 4. The system of claim 1, wherein theultrasound device: receives user input; and adaptively controlsgenerating the 3D printing data in response to the user input.
 5. Thesystem of claim 1, wherein the ultrasound device configures and/orformats the 3D printing data based on a pre-defined 3D printing standardor file format.
 6. The system of claim 5, wherein the pre-defined 3Dprinting standard or file format comprises STereoLithography (STL).
 7. Amethod, comprising: capturing echo ultrasound signals; generatingvolumetric ultrasound dataset, based on echo ultrasound signals;generating based on the volumetric ultrasound dataset, a plurality ofvolume renderings from different viewing directions; generating, basedon the plurality of volume renderings, a 3D mesh; and generating, basedon the 3D mesh, three-dimensional (3D) printing data; wherein the 3Dprinting data is configured to enable producing, via a printer, aphysical volume representation of one or more objects and/or structuresin ultrasound images rendered based on the volumetric ultrasounddataset.
 8. The method of claim 7, comprising: generating 3D modeling ofat least a portion of the one or more objects and/or structures; andgenerating the 3D mesh based on the 3D modeling.
 9. The method of claim7, comprising: receiving user input; and adaptively controlling thegenerating of the 3D printing data in response to the user input. 10.The method of claim 9, wherein the user input is directed to parametersand/or characteristics of the volume rendering.
 11. The method of claim7, comprising configuring and/or formatting the 3D printing data basedon a pre-defined 3D printing standard or file format.
 12. The method ofclaim 11, wherein the pre-defined 3D printing standard or file formatcomprises STereoLithography (STL).
 13. A non-transitory computerreadable medium having stored thereon, a computer program having atleast one code section, the at least one code section being executableby a machine for causing the machine to perform one or more stepscomprising: capturing echo ultrasound signals; generating volumetricultrasound dataset, based on the echo ultrasound signals; generatingbased on the volumetric ultrasound dataset, a plurality of volumerenderings from different viewing directions; generating, based on theplurality of volume renderings, a three-dimensional (3D) mesh; andgenerating, based on the 3D mesh, three-dimensional (3D) printing data;wherein the 3D printing data is configured to enable producing, via aprinter, a physical volume representation of one or more objects and/orstructures in ultrasound images rendered based on the volumetricultrasound dataset.
 14. The non-transitory computer readable medium ofclaim 13, the one or more steps further comprising: generating 3Dmodeling of at least a portion of the one or more objects and/orstructures; and generating the 3D mesh based on the 3D modeling.
 15. Thenon-transitory computer readable medium of claim 13, the one or moresteps further comprising: receiving user input; and adaptivelycontrolling the generating of the 3D printing data in response to theuser input.
 16. The non-transitory computer readable medium of claim 15,wherein the user input is directed to parameters and/or characteristicsof the volume rendering.
 17. The non-transitory computer readable mediumof claim 13, the one or more steps further comprising configuring and/orformatting the 3D printing data based on a pre-defined 3D printingstandard or file format.
 18. The non-transitory computer readable mediumof claim 13, wherein the 3D printing standard or file format comprisesSTereoLithography (STL).